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Abstract — We examine the extent to which Gaussian relay 
networks can be approximated by deterministic networlis, and 
present two results, one negative and one positive. 

The gap between the capacities of a Gaussian relay network 
and a corresponding linear deterministic network can be un- 
bounded. The key reasons are that the linear deterministic model 
fails to capture the phase of received signals, and there is a loss in 
signal strength in the reduction to a linear deterministic network. 

On the positive side, Gaussian relay networks are indeed well 
approximated by certain discrete superposition networks, where 
the inputs and outputs to the channels are discrete, and channel 
gains are signed integers. 

As a corollary, MIMO channels cannot be approximated 
by the linear deterministic model but can be by the discrete 
superposition model. 

I. Introduction 

There have been many efforts to determine the capacities of 
Gaussian networks with multiple sources and destinations. A 
recent proposal is to approximate a given Gaussian network 
by a linear deterministic model which is noise-free, linear, 
and easy to analyze. This model was introduced in [1], [2] 
where the capacity of linear deterministic networks with a 
single source-destination pair is determined. This approach 
was successful for certain Gaussian networks like the interfer- 
ence channel [5], and the MAC and broadcast networks [2], 
where the gap between the capacities of the Gaussian network 
and the linear deterministic network is bounded by a constant 
independent of channel gains. Most subsequent research on 
the linear deterministic model has been focussed on deriving 
coding schemes for Gaussian networks that are inspired by 
those for the deterministic network [4], [6]. 

A. Our results 

We consider Gaussian relay networks with a single source- 
destination pair and multiple relay nodes. The relays have no 
data to transmit but help the source in sending its data to the 
destination. We analyze the extent to which a linear deter- 
ministic model can approximate such networks, by comparing 
their capacities. We show that the gap in the capacities can 
be unbounded. This is since the linear deterministic model 
cannot capture the phase of a channel gain. Even restricted 
to Gaussian networks with positive channel gains, the linear 
deterministic model is not a good approximation. 

As a positive result towards approximating Gaussian net- 
works, we show that an earlier discrete superposition model 



with discrete inputs and outputs [5] serves as a good approx- 
imation for Gaussian relay networks. 

A corollary is MIMO channels cannot be approximated by 
linear deterministic model, but can be by discrete superposition 
models. 



II. Preliminaries 



A. Model 



We consider a wireless network represented as a directed 
graph (V, £), where V = {0, 1, ... , M} represents nodes, and 
the directed edges in £ correspond to wireless links. Denote by 
hij the complex number representing the fixed channel gain for 
link (i, j). Let the complex number denote the transmission 
of node i. Every node has an average power constraint, taken 
to be 1. Node j receives 



hijXi + Zj 



where N'{j) is the set of its neighbors and zj is complex white 



Gaussian noise, 
signals. 



CAf{0, 1), independent of the transmitted 



B. Constructing the linear deterministic network 

Perhaps the best way to understand the linear deterministic 
model [1] is to develop it in a point-to-point setting. Consider 
a simple AWGN channel 



y 



hx + z 



with capacity C = log(l + Let d 



[log|/i|^ 



approximately denote its capacity in the high SNR regime. We 
construct a deterministic network of capacity Cd with a source 
that transmits a binary vector x (of length at least Cd with 
bits ordered from left to right) and a channel that attenuates 
the signal by allowing Cd most significant bits to be received 
at the destination. 

In a general Gaussian network, choose all the inputs 
and outputs of channels to be binary vectors of length 
max(i jjgf [log pj . Each link with channel gain h is 
replaced by a matrix that shifts the input vector and allows 
[log I Zip J most significant bits of the input to pass through. 
At a receiver, shifted vectors from multiple inputs are added 
bit by bit over the binary field. This models the partially 
destructive nature of interference in wireless. The channel is 
simply a linear transformation over the binary field. Modeling 



the broadcast feature of wireless networks, a node transmits 
the same vector on all outgoing links, albeit with different 
attenuation and the number of significant bits arriving at a 
receiver depends on the channel gain. 
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(a) A Gaussian network. 



(b) Linear deterministic model. 



Fig. 1. Linear deterministic model of Gaussian network. (Note [log2.2^J = 
Llog2.52j = 2, [logl.S^J = [logl.S^J = 1) 

The capacity of linear deterministic relay networks with 
a single source-destination pair is known [2]. Recently the 
capacity of Gaussian networks with a single source-destination 
pair was approximately computed [3]. Therefore we can 
compare them. 

C. Cut-set bound 

The cut-set bound [7] of a single source-destination pair 
network, with source and destination M, is 



C 



< max min I{Xn;Ync\Xfia 

p(xo,xi,...,a:A/_i) neA 



(1) 



where C is capacity of the network A is the set of all partitions 
of V with G and M e fi^. 

1) Cut-set bounds for linear deterministic networks: Since 
outputs are a function of inputs in a linear deterministic 
network, / (Xo ; Yhc | ) = H (y^c | Xn<= ) . Maximum value 
of the mutual information equals the rank of the transfer 
matrix Qn.n" associated with the cut ft [2], where the rank 
is determined over an appropriate finite field. An optimal 
input distribution is input variables independent and uniformly 
distributed over the underlying field. Hence ([T]i simplifies to 



C < min rank Gnna. 
n 



(2) 



For Fig. [T(b)l rank of Gn^n. over F2, with fl = {0, 1}, is 2 
with 
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The cut-set bound in (|2]i is achieved by random linear coding 
and hence is the capacity of the network [2]. 

2) Cut-set bounds for Gaussian Networks: Choosing 
{XjYs to be i.i.d. CAf{0, 1) weakens the bound in ([TJ by at 
most (A/ + 1) bits for any choice of channel gains and yields 



C 



min log 1/ + HnHki, 



(3) 



where Hq is the transfer matrix of the MIMO channel 
corresponding to cut and |.| is determinant of the matrix 
[3]. 

In [3], a coding scheme is developed that achieves a rate no 
less than C — k for all channel gains, with k only depending on 



the number M of nodes. Nodes quantize and forward their data 
and the destination eventually decodes the transmitted symbol 
after hearing from all the nodes. This scheme is inspired 
by a coding scheme developed in [2] for a class of general 
deterministic networks. 

III. Unbounded capacity difference of linear 

DETERMINISTIC MODEL 

We will show that capacity of the linear deterministic 
network can be much lower than that of the original Gaussian 
network with their difference unbounded as channel gains are 
varied. 

From the previous section, if capacities of the linear deter- 
ministic network differed and the Gaussian network differed 
by a bounded amount, then the difference between their 
individual cut-set bounds would also be so. We establish 
unboundedness of the difference by comparing mutual infor- 
mation across cuts in a Gaussian network with ranks of the 
corresponding cuts in the linear deterministic network. 

For the rest we choose the inputs Xi for the Gaussian 
network to be i.i.d. CJ\f{0, 1), noting that this can achieve the 
maximum mutual information across any cut within a constant 
bound. For the linear deterministic network, we choose inputs 
that are independent and uniformly distributed over their range 
since that maximizes mutual information across a cut. 

A. Counterexample to constant bit approximation 

Consider the network in Fig. |2(a)| where the channels 
marked as 00 have very high capacity. The mutual information 
across — {0,1,2} is 

IiXn;Yn^\Xn^) = log \I + nH^\ 
= 21og(l + 2|;in 
= 41og|;i| +0(1), as \h\ 00, 



with n = 



h 
h 



This is the minimum among all cuts 



and is therefore the capacity. 




LloglhpJ 



(a) Gaussian network. 

Fig. 2. Counterexample, 



(b) Portion of deterministic net- 
work. 



In the corresponding linear deterministic network, the trans 
fer matrix of Q ^ {0, 1, 2} in Fig. |2(b)]is G = ^ ^ 



I 
The 



/ 

where each identity matrix has dimension [log | Zip J 
capacity of the network is the rank of G, i.e., [2 log \h\\. 

The gap between capacities of the Gaussian network in 
Fig. |2(a)| and its deterministic counterpart is 2 log \h\ + 0{l). 
Therefore the gap cannot be bounded independently of channel 
gains. 



The linear deterministic model considers only the magnitude 
of a channel gain and fails to capture its phase. Constructing 
the deterministic model over a larger prime field does not help 
either. 

B. Gaussian networks with positive channel gains 

Unfortunately phase is not the only problem. We construct 
a Gaussian network with positive channel coefficients that 
cannot be approximated by a linear deterministic network. 




Fig. 3. Two networks with positive channel coefficients. Both have the same 
linear deterministic network in Fig. |2(b)| as their counterpart. 

Consider the Gaussian networks in Fig. [3] where h = 2^ 
for k E The linear deterministic network corresponding to 
both Gaussian networks is the same. However, the difference 
in the capacities of the Gaussian networks is unbounded. 

The capacity of the network in Fig. |3(a)| is 

C = IiXn;Y^\X^^) + Oil) 

= A\ogh + 0{l) (as/i->oo), 

with n ~ {0,1,2}, while the capacity of the network in 
Fig. Mis 

C - I{Xn;Y,^\X^^ + 0{l) 

= 2\ogh + 0{l) (as/i^oo). 

So difference in capacities of the linear deterministic network 
in Fig. |2(b)| and at least one of its counterparts in Fig. |3] must 
be unbounded in h. 

One may wonder if taking the channel gains into account 
and quantizing the gains with respect to a field larger than 
F2 will provide a bounded error approximation. However this 
reasoning is flawed since then the gap in the capacities would 
be a function of the chosen prime and thus, in turn, a function 
of channel gains. 

IV. Approximating Gaussian networks by discrete 

SUPERPOSITION NETWORKS 

A question arises if there is any other deterministic model 
for approximating Gaussian networks. We now show that 
an alternate deterministic model, first mentioned in [5], is 
indeed a good approximation of a Gaussian relay network. 
This model, which we call a discrete superposition model, 
captures the phases of channel gains, and ensures that the 
signal strength does not drop due to quantization of channel 
gains. 



A. The discrete superposition model 

We define the inputs, outputs, and channels in a discrete 
superposition network. Let 

n := max max{[log|/iij_R,|J, [log|/i,y/|J}, 

where hij — hijj^ + thijj. The inputs are complex valued 
and both real and imaginary parts can take 2" equally spaced 
discrete values from {0, 2~", . . . , 1 — 2~"}. It helps to think 
of either the real or imaginary part of an input in terms of 
its binary representation, i.e., (x — Q.x{l)x{2) . . . x{n)) with 
each x{i) e F2. 

The real and imaginary parts of channel gains are quantized 
to integers by neglecting their fractional parts. The channel 
between two nodes multiplies the complex input by the 
corresponding channel gain, and then truncates it by neglecting 
the fractional components of both real and imaginary parts of 
the product. The outputs of all incoming channels at a receiver 
node are complex numbers with integer real and imaginary 
parts. All the outputs are added up at a receiver by standard 
summation over Z + iZ. 

This model retains the essential superposition property of 
the channel. The truncation of channel coefficients does not 
substantially change the channel matrix in the high SNR limit. 
Also, the effect of noise is captured in essentially the same 
way as in the linear deterministic model by truncating least 
significant bits. 

This discrete superposition model was first used in [5] in a 
sequence of networks that reduced the Gaussian interference 
channel to a linear deterministic network. We use some of the 
techniques from [5] in the proof below. In [2], it was shown 
that the cut-set bound is achievable for such deterministic 
networks, provided attention is restricted to product distribu- 
tions for the input signals. The main result presented below 
entails showing that the loss in restricting attention to product 
distributions for inputs is bounded for discrete superposition 
relay networks. The connection with Gaussian relay networks 
or with MIMO channels (see the following Sec. |V]l was not 
made in [5]. There is also no cooperation among the input or 
output nodes in [5], which is a key ingredient of the proof 
below. 

Theorem 4.1: The difference in capacities of a Gaussian 
relay network with a single source-destination pair and the 
corresponding discrete superposition network is bounded with 
the bound depending only on the number of nodes. 

Proof: We prove the result by assuming that the network 
permits only real valued signals. Extending the result to Gaus- 
sian networks with complex valued signals is straightforward, 
but involves more bookkeeping as noted at the end. 

We show that achievable rates in the Gaussian network 
are within a bounded gap of achievable rates in the discrete 
superposition network and vice versa. 

First we start with the Gaussian network and reduce it to 
a discrete superposition network in stages, bounding the loss 
in mutual information at each stage. For specificity consider a 



cut with two input nodes and two output nodes. Let the output 
signals be 



= haxi + h,aX2 + z^, i = 1, 2. 



(4) 



Choose xi, X2 as i.i.d. A/'(0, 1) (since this choice is ap- 
proximately optimal in the sense that it maximizes mutual 
information of the cut up to a constant, see Sec. |II-C.2t . The 
mutual information across this cut is 

IiX,,X2;Yi,Y2) = ilog|/ + HH*|, (5) 

where H is the channel transfer matrix. Our goal is to derive 
inputs to the corresponding discrete superposition channel 
from xi and X2 such that mutual information of the deter- 
ministic channel differs by no more than a constant from (|5]l. 
We begin by scaling all channel gains by half: 

Vi ■■= iha/2)xi + {hi2/2)x2 + 

I I 

= h^iXi + hi2X2 + Zi, i = 1,2, (6) 

with h.-j :— hij/2. The mutual information decreases by at 
most 1 bit in comparison to Q, since 



2 2 



as positive definite matrices. So, 

/(Xi,X2;ri,r2) < I{Xi,X2;YiY^) + l. 

Each Xi can be split into its integer part Xi and fractional 
part Xi. More precisely Xi (sign a;i))[|xi|J, Xi Xi — Xi. 
We discard Xi and retain Xi. Since Xi satisfies unit average 
power constraint, Xi satisfies unit peak power constraint. 
Define 

iji :— h^iXi + h^2X2 + Zi, i ~ 1,2. (7) 
Denote the discarded portion of the received signal by 

Tji = /ijiii + hi2^2, i = 1, 2. (8) 
Comparing with the channel in (|6]l, we get 

I{X,,X2;YiY^) 

< IiX,,X2;Y;,Y;,Y,,Y2,Yi,Y2) 
= I{Xi,X2;Yi,Y2,YuY2) 

h{YuY2,Yi,Y2)~h{Zi,Z2) 

< h{Yi,Y2)-h{Zi,Z2) + H{Yi,Y2) 
= I{Xi,X2;Yi,Y2)+H{Yi,Y2) 

< I{Xi,X2;Yi,Y2)+H{Xi)+H{X2), (9) 

where (|9]l holds because Yi's are a function of Xi's from 
Since Xi is A/'(0, 1), we can show that 

H{X,) = - J2Px^k)\ogpji^{k) < 4. 
fcez 

From (|9]l and above, channel (|7]l loses at most 8 bits compared 
to channel (|6]l. 



Since Xi are not necessarily positive, we obtain positive 
inputs by adding {h^^ + /i^j) ^ yi'. 

y, := y^ + h^^ + h^^ 

= ha{xi + l)/2 + ha{x2 + l)/2 + z, 

hiiXi + hi2X2 + Zi, i^l,2, (10) 

where now Xi lies in [0,1). /(Xi, li, I2) remains equal 
io I{Xi,X2\Yi,Y2). 

The features of the model that we next address are 

1) channel gains are integers, 

2) inputs are restricted to 

n := max(ij)g£[log/iyJ bits, 

3) there is no AWGN, and 

4) outputs involve truncation to integers. 

Let the binary expansion of Xi be O.Xi{l)xi{2) . . .. We get the 
output of the discrete superposition channel by retaining the 
relevant portion of signal ( fTOl i: 



kixf'\ 



t det 
hi2X2 



(11) 



where x^^^ := Xi{k)2~'^, and we have truncated channel 

gains, i.e., hij :— (sign hij)Y\hij\\. To get (fTTl i from (fTOl i. we 
subtracted 



^ {h,j{ij - xf) + {h,j - htj)x' 



det 

j 



frac 



+ Zi 



2 

E 



+ Zi 



(12) 
(13) 



To bound the loss in mutual information, note 

I{Xi,X2;Yi,Y2) 

= h{Yi,Y2)~h{Yi,Y2\Xi,X2) 
= h{YuY2) - h{Zi) - h{Z2) 

< h{Y,^'\ Yt, ei, £2) - h{Z,) - h{Z2) 

< H{Yt'\Y^^') + h{e,) + h{e2) 

- h{Zi)-h{Z2). 

From the definition of in (fT2] i. and since y^*^' are completely 
determined by xf'\x2''\ we can rewrite 

i{Xi,X2;Yi,Y2) < /(xf,xf ;rid^',r2'^^') 



■^(Me»)-Me*|M^H,W^2^)) 



T/ "v^det T^det T^det -i^detN 

— i^Aj ,A2 ,ri , ^2 ) 

+ IiWii,W2i;ei) + I{Wi2,W22;e2). 



< 



By bounding the magnitudes of terms in ( fT2] l. we get 
4. So, I{Wii,W2i;ei) is the mutual information of a MISO 
channel with input power constraint (16 + 16) = 32 and 
/(W^ii, W2i;ei) < 5log(l + 32) < 3 bits. So we lose at 
most 6 bits in the last step. 



We have proved that difference between the maximum 
mutual information across a cut in a Gaussian network and an 
achievable mutual information for the same cut in the discrete 
superposition network is bounded. Repeating this for every cut 
yields a bound that depends solely on number of nodes. 

Conversely, start with a joint distribution for inputs zf* in 
the discrete superposition network. Since a;^'^''s satisfy average 
power constraint, we can apply them directly to the Gaussian 
channel to get 

2/,; hax'l'''^ + h,2xf^ + z„i^l,2. 

We can rewrite yi as 

2 

+ frac(/iy xf )) + z, 

2 

= ■ y^'' + ^Vl^+Z^, 1 = 1,2. 
J = l 

By definition j/^'^' takes on only integer values. Hence y'^^^ can 
be recovered from yi, the integer parts of Uj/s and noise Zi, 
and the carry Ci obtained from adding the fractional parts of 
Vji's and Zi. So, 

r/ x^det vdet. \^del x^det\ 
^(^1 1^2 I'^l >^2 ) 

< I{Xt'\ ; YuY2, {Vj,}, {Z,}, {Ci}) 

2 

2 2 

i=l i=l 

Here Vji, Zi are integer parts of the respective variables. Since 
\vji\ < 2, Vj, e {-2, -1, . . . , 2}, and H{Vji) < 3. The carry 
c^ e {-2, -1, . . . , 2}, hence (C,) < 3. As earlier, H{Z,) < 
4. Therefore mutual information of the Gaussian channel is 
at most 28 bits lesser than that of the discrete superposition 
channel. 

Above arguments can be extended to show that for ev- 
ery joint distribution for inputs in the discrete superposition 
channel, there is a product distribution for inputs with a 
bounded reduction in the mutual information. To complete 
the proof we note that the cut-set bound in ([T]l restricted to 
product distributions is achievable in the discrete superposition 
network [2]. 

For the general case of complex Gaussian networks, we 
allow signals in (HJi to be complex valued and rewrite 







hiiR 


—hill 




XlR 






hill 


hiiR 




Xil 





X2R 


+ 


ZR 




X2I 




Zl 



Now choose inputs to be i.i.d. CA/'(0, 1). Increasing variances 
of both inputs and Gaussian noise from 1 to 2 does not change 



the mutual information, though now XiR, Xn, Zr, Zi are 
7\A(0, 1). Rest of the analysis can be repeated. ■ 

V. MIMO CHANNELS AND DETERMINISTIC MODELS 

Above we analyzed a network by comparing the MIMO 
channels corresponding to the same cut in the Gaussian net- 
work and its deterministic counterpart. We can easily extend 
the negative result in Sec. |lIl]to show that, in general, MIMO 
channels cannot be approximated by the linear deterministic 
model. In the same vein, we can extend the positive result in 
Sec. |lV]to prove that the discrete superposition model remains 
a good approximation for MIMO Gaussian channels. 

VI. Concluding remarks 

Since the capacity of the linear deterministic model does not 
approximate that of the Gaussian relay network, the challenge 
is to quantitatively show to what extent, how, and why good 
coding strategies for the former yield good strategies for the 
latter 

For discrete superposition networks, the challenge is to 
extend the bounded error approximation result to networks 
with multiple sources and destinations. 
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